\n \n \n
\n
\n\n \n \n \n \n \n \n Preliminary study of an RNN-based active interventional robotic system (AIRS) in retinal microsurgery.\n \n \n \n \n\n\n \n He, C.; Patel, N.; Ebrahimi, A.; Kobilarov, M.; and Iordachita, I.\n\n\n \n\n\n\n
International Journal of Computer Assisted Radiology and Surgery,1–10. 2019.\n
\n\n
\n\n
\n\n
\n\n \n \n Paper\n \n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n \n \n 6 downloads\n \n \n\n \n \n \n \n \n \n \n\n \n \n \n \n \n \n \n \n \n \n \n\n\n\n
\n
@article{he2018NNControl,\nabstract = {Purpose: Retinal microsurgery requires highly dexterous and precise maneuvering of instruments inserted into the eyeball through the sclerotomy port. During such procedures, the sclera can potentially be injured from extreme tool-to-sclera contact force caused by surgeon's unintentional misoperations. Methods: We present an active interventional robotic system to prevent such iatrogenic accidents by enabling the robotic system to actively counteract the surgeon's possible unsafe operations in advance of their occurrence. Relying on a novel force sensing tool to measure and collect scleral forces, we construct a recurrent neural network with long short-term memory unit to oversee surgeon's operation and predict possible unsafe scleral forces up to the next 200 ms. We then apply a linear admittance control to actuate the robot to reduce the undesired scleral force. The system is implemented using an existing “steady hand” eye robot platform. The proposed method is evaluated on an artificial eye phantom by performing a “vessel following” mock retinal surgery operation. Results: Empirical validation over multiple trials indicates that the proposed active interventional robotic system could help to reduce the number of unsafe manipulation events. Conclusions: We develop an active interventional robotic system to actively prevent surgeon's unsafe operations in retinal surgery. The result of the evaluation experiments shows that the proposed system can improve the surgeon's performance.},\nauthor = {He, Changyan and Patel, Niravkumar and Ebrahimi, Ali and Kobilarov, Marin and Iordachita, Iulian},\ndoi = {10.1007/s11548-019-01947-9},\nissn = {18616429},\njournal = {International Journal of Computer Assisted Radiology and Surgery},\nkeywords = {Interventional system,Medical robot,Recurrent neural network,Retinal surgery},\npages = {1--10},\npmid = {30887423},\npublisher = {Springer},\ntitle = {{Preliminary study of an RNN-based active interventional robotic system (AIRS) in retinal microsurgery}},\nurl = {https://doi.org/10.1007/s11548-019-01947-9},\nyear = {2019}\n}\n
\n
\n\n\n
\n Purpose: Retinal microsurgery requires highly dexterous and precise maneuvering of instruments inserted into the eyeball through the sclerotomy port. During such procedures, the sclera can potentially be injured from extreme tool-to-sclera contact force caused by surgeon's unintentional misoperations. Methods: We present an active interventional robotic system to prevent such iatrogenic accidents by enabling the robotic system to actively counteract the surgeon's possible unsafe operations in advance of their occurrence. Relying on a novel force sensing tool to measure and collect scleral forces, we construct a recurrent neural network with long short-term memory unit to oversee surgeon's operation and predict possible unsafe scleral forces up to the next 200 ms. We then apply a linear admittance control to actuate the robot to reduce the undesired scleral force. The system is implemented using an existing “steady hand” eye robot platform. The proposed method is evaluated on an artificial eye phantom by performing a “vessel following” mock retinal surgery operation. Results: Empirical validation over multiple trials indicates that the proposed active interventional robotic system could help to reduce the number of unsafe manipulation events. Conclusions: We develop an active interventional robotic system to actively prevent surgeon's unsafe operations in retinal surgery. The result of the evaluation experiments shows that the proposed system can improve the surgeon's performance.\n
\n\n\n
\n\n\n
\n
\n\n \n \n \n \n \n Artificial intelligence, robotics and eye surgery: Are we overfitted?.\n \n \n \n\n\n \n Urias, M. G.; Patel, N.; He, C.; Ebrahimi, A.; Kim, J. W.; Iordachita, I.; and Gehlbach, P. L.\n\n\n \n\n\n\n
International Journal of Retina and Vitreous, 5(1): 1–4. 2019.\n
\n\n
\n\n
\n\n
\n\n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n \n \n \n \n \n \n \n \n \n \n\n\n\n
\n
@article{urias2019artificial,\nabstract = {Eye surgery, specifically retinal micro-surgery involves sensory and motor skill that approaches human boundaries and physiological limits for steadiness, accuracy, and the ability to detect the small forces involved. Despite assumptions as to the benefit of robots in surgery and also despite great development effort, numerous challenges to the full development and adoption of robotic assistance in surgical ophthalmology, remain. Historically, the first in-human-robot-Assisted retinal surgery occurred nearly 30 years after the first experimental papers on the subject. Similarly, artificial intelligence emerged decades ago and it is only now being more fully realized in ophthalmology. The delay between conception and application has in part been due to the necessary technological advances required to implement new processing strategies. Chief among these has been the better matched processing power of specialty graphics processing units for machine learning. Transcending the classic concept of robots performing repetitive tasks, artificial intelligence and machine learning are related concepts that has proven their abilities to design concepts and solve problems. The implication of such abilities being that future machines may further intrude on the domain of heretofore "human-reserved" tasks. Although the potential of artificial intelligence/machine learning is profound, present marketing promises and hype exceeds its stage of development, analogous to the seventieth century mathematical "boom" with algebra. Nevertheless robotic systems augmented by machine learning may eventually improve robot-Assisted retinal surgery and could potentially transform the discipline. This commentary analyzes advances in retinal robotic surgery, its current drawbacks and limitations, and the potential role of artificial intelligence in robotic retinal surgery.},\nauthor = {Urias, M{\\"{u}}ller G. and Patel, Niravkumar and He, Changyan and Ebrahimi, Ali and Kim, Ji Woong and Iordachita, Iulian and Gehlbach, Peter L.},\ndoi = {10.1186/s40942-019-0202-y},\nissn = {20569920},\njournal = {International Journal of Retina and Vitreous},\nkeywords = {Artificial intelligence,Ophthalmology,Retina,Robotic surgical procedures,Robotics},\nnumber = {1},\npages = {1--4},\npublisher = {BioMed Central},\ntitle = {{Artificial intelligence, robotics and eye surgery: Are we overfitted?}},\nvolume = {5},\nyear = {2019}\n}\n
\n
\n\n\n
\n Eye surgery, specifically retinal micro-surgery involves sensory and motor skill that approaches human boundaries and physiological limits for steadiness, accuracy, and the ability to detect the small forces involved. Despite assumptions as to the benefit of robots in surgery and also despite great development effort, numerous challenges to the full development and adoption of robotic assistance in surgical ophthalmology, remain. Historically, the first in-human-robot-Assisted retinal surgery occurred nearly 30 years after the first experimental papers on the subject. Similarly, artificial intelligence emerged decades ago and it is only now being more fully realized in ophthalmology. The delay between conception and application has in part been due to the necessary technological advances required to implement new processing strategies. Chief among these has been the better matched processing power of specialty graphics processing units for machine learning. Transcending the classic concept of robots performing repetitive tasks, artificial intelligence and machine learning are related concepts that has proven their abilities to design concepts and solve problems. The implication of such abilities being that future machines may further intrude on the domain of heretofore \"human-reserved\" tasks. Although the potential of artificial intelligence/machine learning is profound, present marketing promises and hype exceeds its stage of development, analogous to the seventieth century mathematical \"boom\" with algebra. Nevertheless robotic systems augmented by machine learning may eventually improve robot-Assisted retinal surgery and could potentially transform the discipline. This commentary analyzes advances in retinal robotic surgery, its current drawbacks and limitations, and the potential role of artificial intelligence in robotic retinal surgery.\n
\n\n\n
\n\n\n
\n
\n\n \n \n \n \n \n Toward Safe Retinal Microsurgery: Development and Evaluation of an RNN-Based Active Interventional Control Framework.\n \n \n \n\n\n \n He, C.; Patel, N.; Shahbazi, M.; Yang, Y.; Gehlbach, P.; Kobilarov, M.; and Iordachita, I.\n\n\n \n\n\n\n
IEEE Transactions on Biomedical Engineering, 67(4): 966–977. 2020.\n
\n\n
\n\n
\n\n
\n\n \n\n \n \n doi\n \n \n\n \n link\n \n \n\n bibtex\n \n\n \n \n \n abstract \n \n\n \n\n \n \n \n \n \n \n \n\n \n \n \n \n \n \n \n \n \n \n \n\n\n\n
\n
@article{he2019toward,\nabstract = {Objective: Robotics-assisted retinal microsurgery provides several benefits including improvement of manipulation precision. The assistance provided to the surgeons by current robotic frameworks is, however, a 'passive' support, e.g., by damping hand tremor. Intelligent assistance and active guidance are, however, lacking in the existing robotic frameworks. In this paper, an active interventional control framework (AICF) has been presented to increase operation safety by actively intervening the operation to avoid exertion of excessive forces to the sclera. Methods: AICF consists of the following four components: first, the steady-hand eye robot as the robotic module; second, a sensorized tool to measure tool-to-sclera forces; third, a recurrent neural network to predict occurrence of undesired events based on a short history of time series of sensor measurements; and finally, a variable admittance controller to command the robot away from the undesired instances. Results: A set of user studies were conducted involving 14 participants (with four surgeons). The users were asked to perform a vessel-following task on an eyeball phantom with the assistance of AICF as well as other two benchmark approaches, i.e., auditory feedback (AF) and real-time force feedback (RF). Statistical analysis shows that AICF results in a significant reduction of proportion of undesired instances to about 2.5%, compared with 38.4% and 26.2% using AF and RF, respectively. Conclusion: AICF can effectively predict excessive-force instances and augment performance of the user to avoid undesired events during robot-assisted microsurgical tasks. Significance: The proposed system may be extended to other fields of microsurgery and may potentially reduce tissue injury.},\nauthor = {He, Changyan and Patel, Niravkumar and Shahbazi, Mahya and Yang, Yang and Gehlbach, Peter and Kobilarov, Marin and Iordachita, Iulian},\ndoi = {10.1109/TBME.2019.2926060},\nissn = {15582531},\njournal = {IEEE Transactions on Biomedical Engineering},\nkeywords = {Medical robotics,recurrent neural network,retinal surgery,safety in microsurgery},\nnumber = {4},\npages = {966--977},\npmid = {31265381},\npublisher = {IEEE},\ntitle = {{Toward Safe Retinal Microsurgery: Development and Evaluation of an RNN-Based Active Interventional Control Framework}},\nvolume = {67},\nyear = {2020}\n}\n
\n
\n\n\n
\n Objective: Robotics-assisted retinal microsurgery provides several benefits including improvement of manipulation precision. The assistance provided to the surgeons by current robotic frameworks is, however, a 'passive' support, e.g., by damping hand tremor. Intelligent assistance and active guidance are, however, lacking in the existing robotic frameworks. In this paper, an active interventional control framework (AICF) has been presented to increase operation safety by actively intervening the operation to avoid exertion of excessive forces to the sclera. Methods: AICF consists of the following four components: first, the steady-hand eye robot as the robotic module; second, a sensorized tool to measure tool-to-sclera forces; third, a recurrent neural network to predict occurrence of undesired events based on a short history of time series of sensor measurements; and finally, a variable admittance controller to command the robot away from the undesired instances. Results: A set of user studies were conducted involving 14 participants (with four surgeons). The users were asked to perform a vessel-following task on an eyeball phantom with the assistance of AICF as well as other two benchmark approaches, i.e., auditory feedback (AF) and real-time force feedback (RF). Statistical analysis shows that AICF results in a significant reduction of proportion of undesired instances to about 2.5%, compared with 38.4% and 26.2% using AF and RF, respectively. Conclusion: AICF can effectively predict excessive-force instances and augment performance of the user to avoid undesired events during robot-assisted microsurgical tasks. Significance: The proposed system may be extended to other fields of microsurgery and may potentially reduce tissue injury.\n
\n\n\n
\n\n\n\n\n\n